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We show that the conditional min-entropy H nl i n (A\B) of a bipartite state pab is directly related to the 
maximum achievable overlap with a maximally entangled state if only local actions on the B-part of pab are 
allowed. In the special case where A is classical, this overlap corresponds to the probability of guessing A 
given B. In a similar vein, we connect the conditional max-entropy H nliix (A\B) to the maximum fidelity of 
Pab with a product state that is completely mixed on A. In the case where A is classical, this corresponds 
to the security of A when used as a secret key in the presence of an adversary holding B. Because min- and 
max-entropies are known to characterize information-processing tasks such as randomness extraction and state 
merging, our results establish a direct connection between these tasks and basic operational problems. For 
example, they imply that the (logarithm of the) probability of guessing A given B is a lower bound on the 
number of uniform secret bits that can be extracted from A relative to an adversary holding B. 



I. INTRODUCTION 

A central goal of information theory is the (quantitative) 
analysis of processes involving the acquisition, transmission, 
and storage of information. For example, given a (noisy) com- 
munication channel, one may ask at which rate data can be 
transmitted reliably (this is the channel capacity). Or, given a 
source emitting signals, one may be interested in the amount 
of space needed to store the information in such a way that 
the signal can be recovered later (this is the compression rate). 
In the following, we call such quantities operational because 
they are defined by an actual information-processing task. 

Traditionally, most operational quantities are defined 
asymptotically under the assumption that a certain process is 
repeated many times independently} Consider for example 
the problem of data compression. For a random variable X 
and for e > 0, let ■£§ ompr (-X') be the minimum length (mea- 
sured in terms of bits) of an encoding enc(X) such that X 
can be recovered from eac(X) except with an error probabil- 
ity of at most e. The compression rate of a source emitting a 
sequence of mutually independent pieces of data X\, . . . , X n , 
each distributed according to Px, is then defined by 

rr> \ . r is ^compr(^l ' ' ' X n ) 

r C omp r (Px) ■= lim lim . (1) 

£—►0 n— +oo n 

It is maybe one of the most remarkable features of informa- 
tion theory that a huge variety of operational quantities can be 
expressed in terms of a few simple entropy measures. In fact, 
in the asymptotic case where a process is repeated many times 
independently, the (almost) only relevant entropy measure is 
the Shannon entropy (or its quantum-mechanical generaliza- 
tion, the von Neumann entropy). For example, the compres- 
sion rate ([TJ of a source emitting data distributed according 
to Px is equal to the Shannon entropy S of a random vari- 



The independence assumption is sometimes replaced by the less restrictive 
requirement that the process is Markovian. 



able X with distribution Px, i.e., 

r C o mp r(Px) = S(X) . (2) 

This equality is also known as the source-coding theorem [1]. 
Another well-known example is the channel capacity. Ac- 
cording to the noisy-channel coding theorem |1], the maxi- 
mum rate at which information can be transmitted over a noisy 
communication channel is equal to a difference between two 
Shannon entropies (see < TT~3T > below). 

The situation is different in the non-asymptotic case or 
when the independence assumption is dropped. Here, the 
Shannon / von Neumann entropies do no longer give a correct 
characterization of operational quantities. 2 One therefore has 
to replace them by more general entropy measures. In the past 
few years, several such generalizations have been developed, 
notably the spectral entropy rates |2j] , as well as ( smooth ) min- 
and max-entropies JH]. While both notions completely over- 
come the need of independence or Markovian assumptions, 
spectral entropy rates are (as suggested by their name) still 
restricted to asymptotic considerations. In contrast, smooth 
min- and max-entropies are fully general. 3 In particular, no 
repetition of random processes is required. That is, one may 
consider situations where a source only emits one single piece 
of information or where a channel is only used once. 

The aim of the present paper is to propose new opera- 
tional interpretations of these non-asymptotic entropy mea- 
sures. Our main findings are motivated and described in the 
following subsections, which are organized as follows. In 
Section ITaI we review the notion of min-/max-entropies, our 
central object of interest. These entropy measures are the basis 



2 For example, the minimum compression length r (X) defined above 
can deviate arbitrarily from S(X), This is readily verified by the following 
example: Let X be defined as the random variable which takes the value 
with probability i, and with probability 1 is equal to a uniformly dis- 
tributed bitstring of length n. Then S(X) w ~ while £f ompr (X) Ri n for 
any sufficiently small e. 

3 The spectral entropy rates can be seen as asymptotic limits of smooth min- 
/max-entropies (J. 
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for the definition of smooth min-/max-entropies, which can be 
seen as generalizations of Shannon / von Neumann entropy, as 
indicated above. Their properties are discussed later in Sec- 
tion II Al After this preparation, we will turn to connections 
between (smooth) min/max-entropies and operational quanti- 
ties, starting with some important examples in Section lTBl We 
then summarize the new operational interpretations derived in 
this work as well as their implications in Section llCl 

A. (Smooth) min-/max-entropy: Basic definitions 

Min-/max-entropy 

We start with the definition of conditional min- entropy . 
This quantity (and the closely related conditional max- 
entropy) is the main object of study of this paper. In what 
follows, idyi denotes the identity on system A. 

Definition 1. Let p — p A s be a bipartite density operator. 
The min-entropy of A conditioned on B is defined by 

H^A^p := -m£D x {p AB \\\A A 8<tb) (3) 

where the infimum ranges over all normalized density opera- 
tors o~b on subsystem B and where 4 

Doo(t\\t') := inf{A e R : r < 2 A r'} . (4) 

It is interesting to note that the Shannon / von Neumann 
entropy could be defined in a similar way. Namely, if we re- 
place -ffmin by the von Neumann entropy S and by the 
relative entropy 5 D in (01, we find 

S{A\B) P = -miD(p AB \\\d A ® a B ) . 

O'B 

This equality is readily verified using the fact that D(t||t') 
is nonnegative for any normalized r, r' and equals zero 
ifr = r'. 

For a tripartite pure state p = p AB c, the von Neumann 
entropy satisfies the equality 6 

S(A\B) P = -S(A\C) P . (5) 

The same is no longer true for the min-entropy. However, it 
turns out that the entropy obtained by replacing the system 
B by the "purifying system" C often appears in expressions 
characterizing operational quantities. This motivates the fol- 
lowing definition. 



4 For commuting density operators r and r', the quantity Doo (t|[t') corre- 
sponds to the (classical) relative Renyi entropy of order oo. In general, the 
relative Renyi entropy of order a of two probability distributions P and Q 
is defined as D a (P, Q) := ^ log 2 J2 X (a^QM 1- ", and 

is obtained in the limit a — > oo. 

5 Note that the relative entropy (aka Kullback-Leibler divergence) 
D(t\\t') : = tr(r(log2 t — log 2 T')) is also defined for unnormalized 
operators r'. 

6 Note that, by definition, S(A\B) = S(AB) - S(B) and S(A\C) = 
S(AC) - S(C). The equality then follows from the fact that, by the 
Schmidt decomposition, S(AB) = S(C) and S(B) = S(AC). 



Definition 2. Let p — p A B be a bipartite density operator. 
The max-entropy of A conditioned on B is defined by 

H ma]C (A\B) p := -H min (A\C) p (6) 

where the min-entropy on the rhs. is evaluated for a purifica- 
tion p A BC of p AB - 

This is well-defined because all purifications of p A B are re- 
lated by unitaries on C, and the quantity H m i n (A\C) p is in- 
variant under such unitaries. 

We point out that H m i U and i/ max could have been defined 
alternatively by starting from an expression for H niax and sub- 
sequent definition of £f m i n by purification (i.e., ©). In this 
sense, both quantities are equally fundamental. 

If the state p is clear from the context, we will omit the 
subscript in H m i n (A\B) p and H mayi (A\B) p . Also, in the spe- 
cial case where the system B is trivial (i.e., one-dimensional), 
we omit the conditioning and simply write H m i n (A) and 
H max (A). Note that the above definitions also apply to classi- 
cal probability distributions Px which can always be written 
as quantum states px = J2 X Px(x)\x)(x\ for some orthonor- 
mal basis {|a;)}a;. 

To get some more intuition for these definitions, it may 
help to compute their value for certain special states. One 
extreme case are product states p AB — p A ® Pb, for 
which one readily verifies that the min-entropy only de- 
pends on the maximum eigenvalue ||pyi||oo of p A , i.e., 
H m in{A\B) p = — log 2 ||pa||oo- Note that this corresponds 
to the Renyi entropy of order infinity of the density oper- 
ator p A . Similarly, we get H ma ,^(A\B) p = 21og 2 tr v /pJ, 
which is the Renyi entropy of order h of p A (see eq. (l24i > 
below). Another extreme case is where p AB is a pure 
state. Here one finds H m i n (A\B) p = — log 2 (tr v /p / i") 2 and 
H max (A\B) p = log 2 UpaIIoo- 

Smooth min-/max-entropy 

The smooth min/max-entropy of a state p is defined by the 
corresponding (non-smooth) min/max-entropy for an "opti- 
mal" state p' in an e-neighborhood of p, where e is called 
smoothness parameter. 

Definition 3. Let p — p A s be a bipartite density operator 
and let e > 0. The e-smooth min- and max-entropy of A 
conditioned on B are given by 

H^ in (A\B) p := sup H mia (A\B) p , , 

p' 

H^(A\B) P := MH max (A\B) p , . 
p 

where the supremum ranges over all density opera- 
tors p' = p' AB which are e-close to p. 1 



7 In the classical case, smooth entropies are usually defined with respect 
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Basic properties. It follows directly from the definitions 
that the same kind of duality between min- and max-entropy 
holds between the corresponding smooth versions, namely 



H Lnx(A\B) p - -H^ in (A\C) p 



(7) 



for a purification pabc of pab- 

As already indicated, smooth min-/max-entropies can be 
seen as generalizations of the Shannon / von Neumann en- 
tropy S. More precisely, the latter can be written in terms of 
the former [5], i.e., 

S(A\B) p = lim lim - H e min {A n \B n ) p8 n (8) 

S(A\B) p = lim lim -H s max (A n \B n ) p ^ (9) 

Note that the two statements are trivially equivalent because 
of © and 0. 

Given these asymptotic relations, it is not surprising that 
smooth min-/max-entropies share various properties with the 
Shannon / von Neumann entropy. For example, they are 
strongly subadditive, i.e., 



m nin (A\B) > H° min (A\BC) 



(10) 



and likewise for i?,j lax . In fact, inequality ( TTOb can be seen as a 
generalization of the strong subadditivity of the von Neumann 
entropy, S(A\B) > S(A\BC), which can be recovered by 
virtue of identity (O, i.e., for any pabc, 

S(A\B) p i lim lim -H^ lia (A n \B n ) p ^ 

> lim lim -HL in (A n \B*C n ) p »» 
i S{A\BC) P . 

Interestingly, despite its generality, inequality dTOb is easy to 
prove, as we shall see at the end of Section llCl 



B. Operational quantities in terms of smooth 
min-/max-entropy 

The main reason for considering (smooth) min-/max- 
entropies is that they are well suited for the characteriza- 
tion of operational quantities in the most general case. Re- 
call that expressions for operational quantities involving the 
Shannon / von Neumann entropy, e.g., (O, are typically only 



to the trace distance <5 tr (p, a) = i||p — <r||i. Quantum-mechanically, 
distance measures based on the fidelity F(p, a) = || y^v^lli Me more 
suitable because they are invariant under purifications. Candidates are 

the Bures distance \\p — cr\\g = \J 2 — 2^/F(p, a) and the angle 

\\p — a || a = arccos \J F(p, a). The corresponding definitions are es- 
sentially equivalent because of the inequalities 1 — F(p, a) < <5tr(p, <r) < 
VI -F(p,a)\ 



valid asymptotically, under the assumption that certain re- 
sources can be used many times independently. Interestingly, 
the structure of such expressions essentially remains the same 
if one drops these assumptions, except that smooth entropies 
take the place of Shannon / von Neumann entropy. The pur- 
pose of this section is to illustrate this phenomenon with a few 
examples. 

Data compression. We start with the example of data 
compression, which has already been introduced above. For 
a random variable X and e > 0, let again t e compr (X) be the 
minimum length of an encoding from which the value of X 
can be recovered correctly with probability at least 1 — e. It 
can then be shown that £l omnr (X) is essentially equal to the 
smooth max-entropy of X yfl. More precisely, we have 



4 £ ompr (X) = H^(X) + Oflog 1/e) 



(11) 



for some e' S [he, 2s]. The O-notation indicates that equality 
holds up to an additive term of the order log (1/e). 8 In typical 
applications, this logarithmic term is much smaller than the 
other quantities occurring in the expression. In particular, the 
term is independent of the size of the resource (in our case 
the random variable X) and thus becomes irrelevant in the 
asymptotic limit of large resources. 

We stress that ( fTTT i is valid for a single realization of the 
random variable X and thus strictly generalizes Shannon's 
source coding theorem described at the beginning of this sec- 
tion. Identity (O can be recovered as an asymptotic limit 
of ( fTTT l. for X consisting of many independent and identically 
distributed pieces X±,..., X n , i.e., 



rn ^ 

r C om pr (Px) = lim lim - conipl 

e—*0 n— *oo 



r(*l 



■Xr, 



IP lim lim -H^X.-.-X^ 

s— »0 n^oo n 



® 



S(X). 



Channel coding. As a second example, we consider 
the noisy-channel coding problem. For any e > 0, let 



, (X — > Y) be the maximum number of bits that can 



be transmitted in one use of a classical noisy channel X — * Y 
(specified by a conditional probability distribution Py\x) with 
maximum error probability e. As shown in this quantity 
is given by 



Y) = m&x(m 

Px { 



,(X) - Hi ax (X\Y)) 
+0(logl/e) 



(12) 



for some e' S [^e, 2e). 



' Note that the smooth entropies are monotonic functions of e. Equality {TT} 
is thus just a way to state that the operational quantity il ornpr (X) lies in the 

interval pma,(X), ^maiW]' U P to some additive constant of the order 
log 1/e. 
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Similarly to the example of source coding, we may con- 
sider the special case where the channel allows many mutu- 
ally independent transmissions. The figure of merit then is the 

channel capacity 

F (X n — > Y n ) 
r t r ansm (P Y \x) ■= lim lim '- , 

e^O n->oo n 

that is, the maximum rate at which information can be trans- 
mitted by n uses of the channel X — > Y, in the limit of large 
n. Using the non-asymptotic statement (fT2l > together with ^ 
and @, we find 

^*transm (P Y \x) = max(S(X) - S(X\Y)) = maxipf : Y) . 

Px Px 

(13) 

This is Shannon's well-known noisy-channel coding theorem. 

Privacy amplification. Let X be a classical random vari- 
able and let B be (possibly quantum-mechanical) side infor- 
mation. The goal of randomness extraction is to compute a 
bitstring f(X) which is uniform and independent of the side 
information B. Randomness extraction is crucial for a number 
of applications, particularly in the context of cryptography, 
where it is also called privacy amplification J7[]. For exam- 
ple, in a key-agreement scheme, one may want to turn a (only 
partially secure) raw key X into a fully secure key f(X). Se- 
curity of f(X) is then akin to uniformity relative to side in- 
formation B held by a potential adversary. 

The maximum number of uniform and independent bits that 
can be extracted from X is directly given by the smooth min- 
entropy of X. More precisely, let i e syXr (X\B) be the maximum 
length of a bitstring f(X) that can be computed from X such 
that f(X) is e-close to a string Z which is perfectly uniform 
and independent of the side information B. 9 One can show 
that Hi 

t extr (X\B) = H< n (X\B) + 0(\og 1/e) 

where e' € [|e, 2s], In the special case where B is indepen- 
dent of X, this corresponds to the leftover hash lemma [7, 9]. 
For later reference, we also note that 

£ £ extr (X\B) > H min (X\B) + 0(log 1/e) , (14) 

which holds because Hf nin (X\B) is monotonically increasing 
in e and equals H m - m (X\B) for e = 0. 

Decoupling. The previous result can be extended to a 
fully quantum-mechanical setting as follows. Let A and B be 
two quantum systems. The goal is to find a maximum subsys- 
tem A' of A such that the state on A' is completely mixed and 
decoupled from B (conditioned on a suitable measurement on 
the remaining part of A). Let ^ |(.A|.B) ^ e me maximum 



9 See paragraph on max-entropy of classical information in Section lTcl below 
for more details. 



size of A' (measured in qubits) such that this is possible up to 
a distance e. 10 One then finds ||To|. ITU IT^I 1 1 

^ecpi(^l^) - HiMB) + 0(log 1/e) (15) 

withe' e [§e, 2e}. 

State merging. In the same manner as privacy amplifica- 
tion generalizes to decoupling in the fully quantum case, data 
compression (and its relatives such as coding with side infor- 
mation) extends to a fully quantum setting; this is referred to 
as state merging. The setting is described by a tripartite pure 
state \^>abc)- The aim is to redistribute the /I -part to the 
system B by local operations and classical communications 
(LOCC) between A and B. Depending on the (reduced) state 
P = PAB-, this either consumes or generates bipartite entangle- 
ment. Let {-)t £ msrg (A\B) p be the minimal (maximal) number 
of ebits of entanglement required (generated) by this process 
(the distinction between consumed/generated entanglement is 
reflected by the sign of the quantity £% lerg (A\B) p ), such that 
the outcome is e-close to the desired output. 12 One then finds 

l e merg (A\B) p = H^ x (A\B) p + 0(log 1/e) , (16) 

where again e' £ [^e, 2e] (see II 1 211 for details). In fact, the 
>-part of this statement is a direct consequence of decoupling 
result above [11], the arguments in IToll (cf. also Section lTHBI i 
and the definition of H max (A\B) p . 

C. Contribution: Min-/max-entropies as operational 
quantities 

In this paper, we show that min-/max-entropies have di- 
rect 13 operational interpretations. We begin by presenting the 
corresponding results for the special case where we condition 
classical information X on a (possibly) quantum system B. 
The fully general case is discussed later in Section lTC 21 

1. Uncertainty about classical information 

Consider an agent with access to a (classical or quantum) 
system B whose state p x B depends on a classical random 



This distance is quantitatively expressed by the decoupling accuracy, see 
below. 

1 This is based on a tightened version flUl of a bound obtained in fich . 
which shows that projecting onto a random subspace of dimension dim A 1 
achieves decoupling. More precisely, it can be shown 1 11] that the decou- 
pling accuracy of the residual state is, on average over the measurement 
outcome, exponentially small in the difference H m i n (A\B) — log dim A' . 

2 Closeness is measured in terms of the distance of the output state 
p'abb b C ol? me P r °t° c °l to the state l"!?}®^ ® I* BxB^c), where 
I'I'Ab} is an ebit between A and B, I is the number of ebits generated, 
and \^ b 1 b 2 c) is identical to \^abc) when identifying the subsystems 
B\ and A as well as B2 and B. 

3 The term direct refers to the fact that no smoothing is required, in contrast 
to the examples of Section llBl 
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variable X. This situation can be described by a classical- 
quantum state 

P = p X B-=^Px{x)\x)(x\® P % » 

x 

with {la;)}^ a family of mutually orthogonal vectors repre- 
senting the (classical) values of X. 

Min-entropy of classical information is guessing probabil- 
ity. Let p guess (X\B) be the probability that the agent cor- 
rectly guesses X when using an optimal strategy; that is, 
Pguess(^l-B) = J2 x P x{x)tr(E xPg ), where the optimal mea- 
surement strategy is described by the POVM {E x } x on B that 
maximizes this expression. We then show that (cf. Theorem[T|i 

Pg uess(X\B) = 2-*^™? . (18) 

where the entropy is evaluated for the state pxb given by ( fT71 ). 

If no side information B is available or, more generally, if 
the state of B is independent of X, we have 2~- Hmin ( Jif l- B ) = 
||Pj\:||oo = maxj Px(x) as noted in Section lLAl Identity ( fT8l 
then reduces to the trivial fact that the maximum probability 
of correctly guessing X without prior information is equal to 
max,; Px{x). 

Max-entropy of classical information is security of key. 
The secrecy of X when used as a key in the presence of an 
adversary with access to system B is conventionally measured 
in terms of the distance of the state px b (cf. ( fT7| >) to a prod- 
uct state of the form tx <8> Pb, where tx is the completely 
mixed state (corresponding to the uniform distribution on X) 
and where p B is the reduced state on subsystem B. This mod- 
els an ideal situation where the key is perfectly uniform and 
independent of the adversary's system. If the trace distance is 
used, then this distance is directly related to the distinguishing 
advantage between the real and the ideal system. 

One may relax the above and only require that the desired 
state is of the form tx® &b, for some arbitrary density oper- 
ator ub- When using the trace distance, this relaxed definition 
is equivalent to the above up to a factor of 2. Also, since the 
trace distance and the fidelity are essentially equivalent, we 
can use the fidelity. We then get the following measure for the 
secrecy of X relative to B, 

p sscr {X\B) p := \X\ max F(p XB , t x ®<Jb) 2 

= ™ x (j2 y/Px(x)F( P x B ,(TB) S j ■ 

where \X\ is the alphabet size of X (we include this factor 
here for convenience). We show that (cf. Theorem|3]l 

p secr (X\B) p = 2 H —™* . (19) 

If no side information B is available or, more 
generally, if B is independent of X, we obtain 

2 H lnax (x\B) p = ^j2 x y/P^xj) (cf. Section H). Iden- 
tity ( fT9l then simply expresses the fact that the secrecy of 
X in this case is quantified by the distance of Px to the 
uniform distribution (where distance is measured in terms of 
the fidelity). 



2. Uncertainty about quantum information 

We now discuss the fully general case, where we have an 
arbitrary bipartite state p = pab- The min-/max-entropies 
carry the following operational interpretations. 

Min-entropy is maximum achievable singlet fraction. De- 
fine the maximally entangled state 

\$Ab) := ^=^2\x a )\xb) 

* X 

where {|a; J i)}^_ 1 is an orthonormal basis of subsystem A 
(of dimension d) and {|£b)}^ =1 is a family of mutually or- 
thogonal vectors on subsystem B (we assume that dim A < 
dimB). We define the "quantum correlation" q C on(A\B) p as 
the maximum overlap with the singlet state I^as) that can 
be achieved by local quantum operations £ (trace-preserving 
completely positive maps) on subsystem B, that is 

qcon{A\B) p := dvaaxF({id A <g> £ )(pab), \$>ab)(<5>ab\) 2 ■ 

(20) 

We show that (cf. Theorem[2]) 

qcon(A\B) p = 2 - H ^ A ^» . (21) 

Note that in the case where the information is classical, i.e., 
if p = px b is of the form ( TTTb . we have 

ycorr 

(X\B) p = max 

x 

The operation £ can be interpreted as a guessing strategy, so 
that (x\£ (p B )\x) becomes the probability of correctly guess- 
ing X if X = x. We thus recover the maximum guessing 
probability pg U ess as a special case, i.e., 

Qcorr 

(X\B) p = Pgue5S (X\B) . 

Max-entropy is decoupling accuracy. The decoupling ac- 
curacy is a parameter that can be seen as the quantum ana- 
logue of the error probability in classical coding theorems and 
is also called quantum error in OH EH]; it measures the qual- 
ity of decoupling as follows. It is defined as the distance 
of pab to the product state ta <8> ct b , where ta is the com- 
pletely mixed state on A and a B is an arbitrary density oper- 
ator. In a cryptographic setting, it quantifies how random A 
appears from the point of view of an adversary with access to 
B. As above for classical A, we define a fidelity-based version 
of this quantity as 

gdecpi(^4|-B) p := d A m.axF(pAB,T A <8> a B ) 2 , (22) 

where dA is the dimension of A and ta is the completely 
mixed state on A. We show that (cf. Theorem^ 

q decp i(A\B) p = 2 H — . (23) 

It is immediately obvious that this generalizes the security 
parameter for a classical key X, i.e., for p — pxb of the 
form ( fTTT i, we have 

gdecpl(^|B)p = Psecr(X\B) p . 
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Implications. A main implication of our results is that 
they establish a connection between seemingly different op- 
erational quantities. For example, because the number 
£l xtr (X\B) of uniform bits that can be extracted from X 
with respect to side information B is lower bounded by 
ff min (^|5) (see di), we find that 

l e &tt {X\B) > -log 2 p guess (X|£?) + 0(logl/e) , 

In other words, the negative logarithm of the guessing prob- 
ability of X tells us how many uniform bits we can extract 
fromX (relative to some system B). This connection between 
randomness extraction and guessing entropy may be useful 
for applications, e.g., in cryptography. Here, the derivation 
of lower bounds on the amount of extractable randomness is 
usually a central part of the security analysis (see fl [l4To . 

Our results can also be used to prove additivity prop- 
erties of the min-/max-entropies. One of them is additiv- 
ity of the min-/max-entropies for independent systems. Let 
Paa'bb 1 = Pab <& PA'B' ■ Then, by the definition of g corr , 

q con {AA'\BB') > q corr {A\B) ■ qcorr (A'\B') . 

By virtue of (fJTJ, this is equivalent to 

H min {AA'\BB') < H min (A\B) + H min {A'\B') . 

Note that the opposite inequality follows immediately from 
the definition of H m \ n and the additivity of D^. We thus 
have 

H min (AA'\BB') p = H min (A\B) + JT min (A'|fl') 
and, equivalently (by the definition (O) 

H n ^{AA'\BB') p = H max (A\B) + H niax {A'\B') 

A second example is the strong subadditivity of conditional 
min-entropy ( TTOb . Here, it suffices to notice that every trace- 
preserving completely positive map £ acting on B can also be 
understood as acting on registers B and C, hence, 

ycorr Qcorr 

(A\BC) P 

for every quantum state pabc- By d2Tb . this is equivalent to 

H min (A\B) p > H min {A\BC) p 

The extension to smooth min-entropy ( fT0T > is straightforward 
(see Lemma 3.2.7 of |5[]). 

Our results also simplify the calculation of the min-/max- 
entropies. As an example, let us calculate the entropy 
Hm ax (A\B) p for a state of the form pab = Pa®Pb- By d23l , 
it suffices to determine the quantity qdecp\{A\B) p , which is 
given by 

qdec P \(A\B) p = maxd A F(p A (g> p B ,r A ® a B ) 

where ta is the completely mixed state on the <1a -dimensional 
Hilbert space A. Using the multiplicativity of the fidelity, we 



find 

gdecpi(-4|-B) p = d A F(pA 1 T A )ina^F(pB,<JB) 
= d A F(p Al T A ) 
= \\y/pZ\\t- 

We thus obtain 

H max (A\B) p = 21ogtrV75I , (24) 

for any p = pab of the form pa ® Pb- This corresponds 
to the Renyi entropy of order i, which is hence the natural 
counterpart to the min-entropy (Renyi entropy of order oo). 
As noted in [3], the Renyi entropy of order a, for any a < 1, is 
-up to small additive terms of the order log |- determined by 
a smoothed version of H (pa) '■ = log'2 rani^p^). The max- 
entropy H max of a density operator can thus be interpreted as 
a measure for its rank. 



Outline of the remainder of this paper 

In Section|nl we discuss some mathematical preliminaries, 
in particular semidefinite programming, which plays a crucial 
role in our arguments. Our main results are then stated and 
proved in Section Hill 

II. SOME TECHNICAL PRELIMINARIES 
A. Semidefinite programming 

Our central tool will be the duality between certain pairs of 
semidefinite programs. It will be convenient to use a fairly 
general formulation of this duality; a derivation of the results 
summarized in this section can be found, e.g., in 115, Sec- 
tion 6]. The presentation here follows this reference, but spe- 
cializes certain statements to the situation of interest for sim- 
plicity. We start by introducing a few definitions. 

A subset K C V of a vector space V is called a con- 
vex cone if G K and pv + vw € K for all nonnegative 
p,, v > and v,w E K. A convex cone K gives rise to a 
partial order relation <j{ on V, defined by v <k w if and 
only if w — v € K. If V is an Euclidean space with inner 
product (•, •), then the dual cone K* C V of K is defined 
by K* = {v e V I (v, w) > for all w e K}. The interior 
int K C K is the subset of points w £ K for which there 
exists an open ball centered around w and contained in K. 

Let Vi and V2 be Euclidean spaces with inner prod- 
ucts (v)i and (v)2, respectively. A linear map 
E* : V-2 — * Vi is called dual of or adjoint to a linear map 
E : Vi -> V 2 if 

(Evi,v 2 )2 = (vi,E*v 2 )i for all v\ € Vi,w 2 € V 2 . 

For a given map E, the dual map E* is necessarily unique if 
it exists. The two linear programming problems we are in- 
terested in are defined in terms of a pair of such maps. They 
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are referred to as the primal and dual problem, and are spec- 
ified by parameters c 6 Vi and b G V2. The programs are 
expressed by the following optimizations: 
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primal 



. .dual 



inf 

Ev!> K2 b 
SUP U2 > K »0 (&,«2>2 

E*V2< K * C 



(25) 



We will usually assume that the sets we optimize over are non- 
empty. (In the language of linear programming, there exists a 
feasible plan and a dual feasible plan.) The weak duality the- 
orem states that <yP nmal > -y dual . We are particularly interested 
in conditions for equality. (This is referred to as a zero dual- 
ity gap.) A simple criterion is Slater's inferiority condition, 
which states the following 

Lemma 1. Suppose that there is an element v G int K\ such 
that Ev — b G int K^. Suppose further that the infimum in ( 125t 
is attained. Then 7 P rimal = y 



dual 



Lemma 2. The adjoint map 

t : Q.PTPM{H Al H B ) - CPUM(H B ,H A ) 

a bijection with inverse 

t : CP{JM(H b ,Ha) -> CPTPM(Ha,H b ) ■ 

Let 6a be the dimension of Ha and let {|af).A}a:e[dA] be 
an orthonormal basis of Ha- (We will restrict our attention 
to finite-dimensional Hilbert spaces.) Let Ha' — Ha be 
a Hilbert space with orthonormal basis {|x)A'};ce[d A ]- The 
maximally entangled state on Ha <8 Ha 1 is defined as 



\®AA> 



1 



\x)a O |x)a' 



(28) 



The Choi-Jamiolkowski-map J takes operations 
£ : £(X4') -> £(H B ) to operators J(£) G C{H A ®H B )- It 
is defined as 



B. Quantum operations 

Let 7^ be a Hilbert space and let C(Ha) be the set of linear 
maps E : Ha — > Ha- An element E G C(Ha) is called 
nonnegative (written £ > 0) if (t/>|-E|^i) > for all |^) G 
Ha- A positive element S (written E > 0) is defined in the 
same way with a strict inequality. 

An operation is a linear map £ : C(Ha) C(Hb)- It 
is called trace-preserving if tr(£ (E)) = tr(E) for all E G 
C(Ha)- It is unital if it maps the identity on 7Ya to the identity 
on 7Ys, i.e., if £ (id^) = ids. The map is called positive if 
> for all £7 > 0. It is completely positive (CP) if 
id fi <g> £ : C(Hr ® Ha) — * £(Hr <8> Hb) is positive for any 
auxiliary space 7i#, where id/j is the identity operation. A 
quantum operation is a completely positive trace-preserving 
map (CPTP). The adjoint map of an operation £ : C(Ha) — > 
C(Hb) is the unique map £^ : C{Hb) — > C(Ha) satisfying 

for all £U G £(W A ) and F B G £(H S ). Note that (£t)t = £ ; 
id^ = id A and {£ ® T)^ = £^ 8) for two maps £ and JF. 
Two easily verified properties which follow directly from this 
definition are 

£ is unital if and only if £* is trace-preserving , (26) 

and 

£ is positive if and only if £ T is positive . 

In particular, the last statement implies that 

£ is completely positive (CP) if and only if £' is CP . (27) 

Statements d26T ) and ( 1271 ) can be summarized as follows. Let 
us define CPTPM(Ha, Hb) as the set of quantum operations 
£ : C(H A ) -> C(H B ) and CPUM{H B ,H A ) as the set of 
completely positive unital maps T : C(Hb) £(Ha)- We 
then have 



J(£)=d A (idA®£)Q*AA<){*AA<\) ■ 

It has the following well-known properties. The equivalence 
of statements {j} and (OH in the following lemma is an imme- 
diate consequence of Lemma|2] 

Lemma 3 (Choi-Jamiolkowski isomorphism, [16]). Let 
Ha — Ha> and Hb be arbitrary Hilbert spaces. The map 
J bijectively maps 

(i) the set CPTPM(Ha> , Hb) to the set of operators 
F A b > with tr B F A B = id a- 

(ii) the set CPUM(Ha' , Hb) to the set of operators 
Eab > with tr aEab = ids- 

Another concept we will need is the notion of classical- 
ity, which allows us to treat ensembles as quantum states. 
We will say that a Hermitian operator Eab on a bipartite 
Hilbert space Ha <S> Hb is classical relative to an orthonor- 
mal basis {\x)A}xe[d A ] °f "H-a if it is a linear combination 
of operators of the form \x)(x\ <£> Eb, where x G [<2a] and 
E B G Herm(W s ). 

III. MAIN RESULTS AND THEIR DERIVATION 

We are now ready to prove our main statements. We first 
focus on the min-entropy in Section UlIAl The interpretation 
of max-entropy will then follow, as discussed in Section lTHBI 

A. Proof of the operational characterization of f/ m i n 

With Lemma Q] from Section Hi Al it is straightforward to 
prove the following statement. Note that we restrict our atten- 
tion to finite-dimensional Hilbert spaces. Since the optimiza- 
tions are now taken over compact sets, we can replace inf and 
sup by min and max, respectively. 
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Lemma 4. Let Ha and Hb be finite-dimensional Hilbert 
spaces, and let Pab end Ob be nonnegative operators on 
Ha ®Hb and TIb, respectively. Then 

min tr(o-fl) = max tr (pab-Eab) ■ (29) 

a B >0 E AB >0 

ld A ®CTB>PAB tr A (E A B) = idB 

In addition, if pab is classical on Ha relative to an orthonor- 
mal basis {\x)} x , then the maximization rhs. of j29\ can be 
further restricted to those operators Eab which are classical 
on Ha relative to {\x)} x . 

Proof. For a nonnegative operator Eab with tr^ii^s £ ids, 
we can define the operator 

e 'ab = e ab +ka® (ids - ^a(Eab)) , 

where ka is an arbitrary normalized density operator on Ha- 
We then have 

tr(p A BE AB ) > tr(pABEAB) 

with E' AB > and XrA{E' AB ) — ids- This shows that we can 
extend the maximization on the rhs. of d29l ) to all operators 
Eab whose partial trace tr a{Eab) is bounded by ids (in- 
stead of being equal to ids). The claim is therefore equivalent 
to 



mm 

CT B >0 
\d, A ®0 B >PA, 



tr(o-s) 



max 

E AB >0 
tr A (E AB )<id B 



tr(pA B E A B) (30) 



To relate this to the general linear programming problem d25l ). 
we define Vi = Herm(7Ys) and V2 = Herm^^ eg) Hb) as 
the (real) vector spaces of Hermitian operators on Hb and 
Ha ® Hb, respectively, with standard Hilbert-Schmidt in- 
ner product. Furthermore, we define the convex cones K\ 
and K2 as the set of nonnegative operators in Herm(7is) 
and Herm(7i J 4 ® Hb), respectively. We claim that these 
cones are self-dual, i.e., K* — K\ and K% = K%. This 
is easily seen from the spectral decomposition of a Hermi- 
tian operator. Finally, we define E : Vi — > V2 as the lin- 
ear map E(9b) = E9b ■ = id a <S> Ob- It is easy to check 
that the adjoint E* : V2 — > Vi is equal to the partial trace 
tr^ : Herm(H.A <8 Hb) — * Herm(7is); indeed, for all 
9b & Herm(Hs) and Fab € Herm(W^ ® Ws), we have 

(E9 b ,F A b)2 = ^a®0 b ,F A b)2 
= tr((\d A ®9 b )F A b) 
= tr{9 B tr a {Fab)) 
= (9 b ,Ua(Fab))i ■ 

We also set b = pab and c = ids. With these defini- 
tions, we conclude that the two optimization problems defined 
by d30b are a special instance of (l25l i: the claim is equivalent 
to the statement that the duality gap vanishes. According to 
Lemma [TJ it suffices to check Slater's interiority condition. 
For this purpose, we set v = 2A max (p^s) 1 ids, where A max 
denotes the maximal eigenvalue. Clearly, v is in the interior 
of K\ . We also have 

Ev-b = 2A max (/0As)idAs - Pab > , 



hence Ev — b S int K2', this proves the claim ( f30b . 

To prove the claim about the case where pab is classical 
relative to an orthonormal basis {la;)}^ of Ha, we simply set 
V2 = span{|a;)(a;|} s (£> Herm(7is) equal to the set of Hermi- 
tian operators that are classical on Ha- The remainder of the 
proof is identical to the general case. □ 



Observe that the lhs. of d29l is equivalent to a minimization 
of the distance measure Doo from dU, i.e., we have 

log min tr((T B ) = min {p A B \ \ '^A <8 a B ) 

cr B >0 O"b>0 
\A A ®a B >PAB tr(<T B ) = l 



-H min (A\B) p . 



(31) 



Let us discuss the case where px s is classical on X. Lemma|4] 
allows us to show that the min-entropy H m i U (X\B) p is equiv- 
alent to the "guessing-entropy" of X given B. 

Theorem 1. Let pxs = *52 x Px\x)(x\ ® p B be classical 
on Hx- Then 

H mia (X\B) p = -\og Pguess (X\B) p , 

where Pguess (X\B) p is the maximal probability of decoding X 
from B with a POVM {E B } X on Hb, i-e., 



p gU ess(X\B) p := ma,x }_^ Px tr(E B p B ) 

{E B lx _ 



Proof. According to (fJTJl, it suffices to show that the rhs. 
of d29l i is equal to Pguess(^|-S)p. But this is a direct conse- 
quence of the fact that every nonnegative operator Ex s with 
trx(ExB) = ids which is classical on Hx has the form 



E X b = ^2\x){x\®E% , 



where the family {E B } X is a POVM on Hb- 



□ 



The Choi-Jamiolkowski isomorphism yields an operational 
interpretation of the min-entropy in the general case. We can 
express the min-entropy as the maximal achievable singlet 
fraction as follows. 

Theorem 2. The min-entropy of a state pab on Ha ® Hb 
can be expressed as 

H min (A\B) p = - \ogq corr {A\B) p , (32) 

where q C orr{A\B) p is the maximal achievable singlet fraction, 



qcon{A\B) p := d A maxF^id^ ® F){pab), \$aa>) (<S>aa> |) , 

with maximum taken over all quantum opera- 
tions T : C(Hb) —* C(Ha'), Ha> — Ha and \$AA') 
defined by I 



9 



Proof. Let us rewrite statement (f32l > as 

min Doo (pab 1 1 idyl ® o B ) 

CT B >0 

tr(<r B )=l 



(33) 

2^ 



log (d A • max F( (id a <8> F){pab), \$aa>){$aa>\) 



where |<I>aa') is the maximally entangled state. Let Eab be a 
nonnegative operator on Ha ® with tr a Eab — ids, and 
let £ = J-\E A b) G CPUM(H A >,H B ) be the unital map 
corresponding to Eab under the Choi-Jamiolkowsi isomor- 
phism (cf. Lemma E]©). Let T = £ t : C(H B ) -> £(Wa') 
be the adjoint quantum operation (cf. Lemma |2). By defini- 
tion of £ and the adjoint (id a ® £)t = idA ® ft = id^ ® 
we have 

tt^ab^ab) = dAtr(/UB(idA®£)(|$AA')($AA'|)) 
= rf A tr((id A 0f)t(p Afl )|$ Aj4 ,)($ AA ,|) 

= d A tr ( (id A ^XpAB^AA'K^AA'l) • 

Observe that the operators Eab > with Xr A E A B = ids 
are in one-to-one correspondence with quantum operations 
T G CPTPM(Hb,'Ha') constructed in this fashion. The 
claim ( 1331 therefore follows from Lemma|4]and (|3T1 i. □ 

Remark 1. 77ie result of Theorem [2] can fee extended to 
give an alternative expression for the maximal achiev- 
able fidelity with a non-maximally entangled state 
\®AA') = J2x V / A|A)a|A)a' G Ha ® Ha'- We assume 
that TLa' — Ha and that \^aA') has maximal Schmidt rank. 
Let ta — ft A 'V& AA') i^AA' I be its reduced density operator. 
Then 



mm {PAB 1 1 t a 1 (g) cr s ) 



o- B >0 

tr(<rs) = l 



= log max F ( (id a O^) (pab), \^AA')(^AA'\) 



(34) 

2 



/or any bipartite state pab on TLa <8> Hb- Statement (1341 ) fol- 

lows by substituting {t a 2 ® ids)pAs(' r A^ 2 ® ids) / or Pab 
in ( 1331 l, tw/ng f/ze /acf fnaf conjugating with an in- 
vertible matrix does not change operator inequalities, 



and y/dX ■ (t a <g> ids)|i> 



AA' 



I* 



A A' 



B. Proof of the operational characterization of _£f max 

To obtain the operational characterization of H nmx , we use 
Theorem|2] Recall the definition of the decoupling accuracy 
of a bipartite state p = pab, that is, 

qdec ? \{A\ B ) P '■= d A max F (pab j Ta ® cb) 2 , 

where dA is the dimension of Ha and ta is the completely 
mixed state on Ha- We begin by showing the following lower 
bound on the decoupling accuracy. 

Lemma 5. For all bipartite states pab, we have 

2 H^(A\B) P < qdscMB)p . 



Proof. Let pabc = I Vabc)( ( Pabc I be a purification of ,oab, 
and let : C(Hc) — * £(Ha') be a quantum operation that 
satisfies (cf. Theorem[2]i 

2- H ^ A \ c ) =d A F{(\d A ®T){p AC ),\®AA-)? ■ 

Let p'aa'br = \ < Paa'br)( ( P , aa'br\ be a purification of 
PabA' = ( id AB ® ^"Xpabc). We then have 

2 H max (A|B) = 2 -H min (A|C) 

= cUF(PaA',I$AA'» 2 (35) 

However, 

F(p^ A „ |0>AA'» = F{Waa>B R ), \*AA>) ® |^Bb) ) 

for some state |#_b_r) on 7Yb <8> Wr. By the monotonicity of 
the fidelity, we therefore get 

F(p' AA ,, \$AA')) < F(p A B,T A ®ft R \6 B R)(6BR\) 

< max F(pab,ta ® cr B ) , 

where we used the fact that p' AB = pab- Inserting this 
into d35b gives the claim. □ 



The proof of the converse inequality closely follows a 
derivation in 111 311 . We include it here for completeness. 

Lemma 6. For all bipartite states pab, we have 

2 B max (A|B) p > qdecpl{A \ B)p . 

Proof. We use the following fact, which is a consequence 
of the fact that all purifications of a fixed state are re- 
lated by a unitary transformation on a (possibly extended) 
ancilla. If \4>abcc) has a reduced state of the form 
ftcc'\4>ABCC'){<t>ABCC> \ = t a ® <Jb, where t a is the com- 
pletely mixed state on Ha, then there exists a unitary Ucc 
such that 



(id A ® ids ® U C c)\(f> 



ABCC 



I* 



AC)V>BC 



(36) 



for some state \9bc) on Hb®'Hc'i where |$ac) denotes the 
fully entangled state on Ha ® He (without loss of generality, 
we can assume that c?a < dc)- 

Let erg be an arbitrary state on Hb- Let 
Pabc = \iPabc)(iPabc\ be a purification of pab, where we 
assume the dimension of He to be sufficiently large. 

According to the definition of the fidelity, there exists a pu- 
rification \4>abcc) °f t a <& o~b such that 

F{pAB,TA <8> Ob) = F(\l/)ABC)\0C>), \$ABCC>)) ■ 

Applying the unitary Ucc from d36l > gives 

F{pABi T A ® 0~b) = F{\tpABCC')> \*&Ac)\9bC')) , 

where | ip' ABC c>) = (idA<8»ids(E)t/cc')lV' J 4Bc)|0c') because 
of the invariance of the fidelity under unitary operations. Us- 
ing the monotonicity of the fidelity, we conclude that 

F{ P AB,TA <8 Ob) < F{X.r B C'W A BCC')WABCC'l \®ac)) 

= F((\d A ®F){pAc)A<i>Ac)) , 
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where T : C(TLc) — > C(TLc) lS the quantum operation 
= tr c -(L/ C(7 '( j o(g) |0) (0 1 cO^cc)- Squaring both sides 
of the previous inequality, multiplying by d A , taking the max- 
imum over all quantum operations and using Theorem[2]there- 
fore gives 

d A F( PA B, T A ® °B? < 2- H ^ A M» . 

Since as was arbitrary, we can maximize the lhs. over all as- 
The claim then follows from the definitions of <Zdecpi(^4|-B)p 
andff max (A|B) p . ' □ 

In summary, we have shown the following result. 

Theorem 3. Let pab be a state on TLa ®7~Lb, and let ta be 
the completely mixed state on TLa- Then 

H max (A\B) p = log q decp] {A\B) p , 
where qdecp\{A\B) p is the decoupling accuracy, defined by 

qdec P \(A\B) p := d A maxF(pAB, t a <8> a B ) 2 , 
with the maximum taken over all normalized states <jb onTLB- 

IV. CONCLUSIONS 

In information theory, entropies are generally interpreted as 
measures of uncertainty . One method to make this interpre- 
tation more precise is to establish relations between entropy 
measures and operational quantities, that is, quantities that 
characterize actual information-theoretic tasks. 

Here we consider a general scenario consisting of a (pos- 
sibly quantum-mechanical) system A as well as an observer 
with (quantum or classical) side information B. The uncer- 
tainty of the observer about the state of system A then depends 
on the distribution of these states as well as the correlation be- 
tween A and B. 

There are two extreme situations, namely when A is com- 
pletely undetermined and when A is determined. Taking into 
account the side information B, these two situations are de- 
scribed as follows. 

1 . The state of A is fully correlated with (parts of) B. 14 

2. The state of A is uniformly distributed and independent 
of the side information B. 

Note that in the first case, the requirement is merely that A 
is correlated with parts of B. This is because the side- 
information B may consist of additional information that is 
unrelated to A. 

For any given state pab, we may characterize the uncer- 
tainty of A given B by the distance to these extreme situations. 



If we take as a distance measure the overlap (i.e., the square 
of the fidelity), we retrieve the definitions of q corr (A\B) and 
qdecp\(A\B) (see (l20l and (l22l . respectively). Our main results 
imply that these correspond to H m - m (A\B) and iJ max (yl|i?), 
respectively. We thus conclude that H m i n (A\B) quantifies the 
closeness to a situation where A is determined by B, and, like- 
wise, H max (A\B) corresponds to the closeness to a situation 
where A is independent of B (see second column of Table|I]i. 

Given a bipartite state pab, we may also ask for the number 
of maximally entangled or completely independent qubits one 
can extract from A. Very roughly speaking, this is the idea 
underlying the definitions of e e merg (A\B) and l E d \(A\B), 
respectively (see Section II Bl for more details, in particular 
the interpretation of negative quantities). Remarkably, these 
quantities are (approximately) given by the smooth entropies 
H^ ax (A\B) and H< n (A\B) (see last column of Table H). 15 

Despite these similarities between the (previously known) 
operational interpretations summarized in the last column of 
Table U and those given in the second column (the ones de- 
rived here), there are at least two fundamental differences. 
The first is that the new interpretations are exact and, in par- 
ticular, valid without a smoothness parameter. In contrast, all 
previously established interpretations only hold up to additive 
terms of the order log i, where s is a smoothness parameter 
(whose meaning is that of an error or failure probability). A 
second difference is that there does not seem to exist an ob- 
vious asymptotic counterpart for our identities. In particular, 
there are no analogous operational interpretations of the von 
Neumann entropy. 

The results of this paper suggest that studying operationally 
defined quantities may be a viable approach to identifying rel- 
evant single-shot information measures in a multipartite set- 
ting. Of particular interest is the conditional mutual informa- 
tion, which has only recently been given an asymptotic inter- 
pretation lfl7tl . 
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In the general case where A and B are quantum-mechanical systems, full 
correlation is akin to maximal entanglement. 



Note that compared to the discussion of the distance, the role of max and 
min is interchanged. 
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goal 
(extremal state) 


quality of a state pab 
(measured in terms of overlap) 


amount of extremal states 
contained in a state pAB 
(measured in # of qubits on A) 


A fully entangled with B 


- log q corf (A\B) 




n(A\B) 


-l e mag {A\B) 1 -H^(A\B) 




classical A fully determined by B 


-logp gueS5 (A|B)^ 






A fully mixed and indep. of B 


- log q decp \(A\B) 


> = -Hma 


AA\B) 


^c P [(^|s)'i 1 ^' in (A|s) 


classical A uniform and indep. of B 


-lo gPsecr (A|B) j 







TABLE I: Operational interpretations of (smooth) min- and max-entropies. The approximation (~) indicates that equality holds up to an 
additive term of order log 1 and for an appropriate choice of the smoothness parameter e'. 
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